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(57) Abstract: Calibrating a seamless 
tiled display image having multiple 
overlapping discrete images produced by 
multiple displays includes generating a 
display-to-screcn spatial transformation 
function to reduce one or more undesir- 
able geometric projector characteristics 
for each of the projectors used in the 
tiled display. Then the method includes 
generating a screen-to-camera spatial 
transformation function to reduce one 
or more undesirable geometric camera 
characteristics for each of the cameras 
used in capturing the tiled display 
images used in the calibration. Then 
the method requires generating a spatial 
luminance transformation function for 
effective color calibration for each of 
the displays images in the tiled display. 
Then the method requires inputting a 
high-resolution image into a tiled display 
processor to form the tiled images of 
the tiled display, segmenting the inputted 
high-resolution image to form tiled 
images based on an array of images used 
in the tiled display, and pre-warping each 
of the segmented tiled images using the 
display-to-screen spatial transformation 
function to reduce the one or more non desirable geometric projector characteristics. Then the method requires applying an inverse 
of the spatial-luminance transformation function to each of the pre-warped images to effectively blend colors in the tiled display 
images. 
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ELECTRONIC CALIB RATION FOR SEAMLESS TILED DISPLAY USING 
OPTICAL FUNCTION GENERATOR 

The invention described herein was made in the performance of work under 
NASA Contract NAS1-20219, and is subject to the provisions of Section 305 of the 
National Aeronautics and Space Act of 1958 (42 U.S.C. 2457). The government may 
have certain rights in the invention. 

Field of the Invention 

This invention relates generally to the field of optical displays, and more 
particularly pertains to calibrating tiled displays using multiple projectors to produce 
a large, and/or a higher resolution image. 



Background 

Multiple projection displays have been proposed and used for many years. In the 
1950's, the "CINERAMA" system was developed for the film industry. The 
CINERAMA system used three films to project three images using three separate 

20 projectors, which were then combined to form a single panoramic image. Disneyland 
continues to use a similar multiple projector system, wherein a circle of projectors shine 
onto a screen that circles the wall of a round room. 

In the video field, multiple projector systems have been proposed and used 
for a number of specialty applications. U.S.Patent No. 4,103,435 to Herndon and 

25 U.S.Patent No. 3,833,764 to Taylor suggest using multiple projector systems for 

flight simulators. In many of these systems, multiple video screens are placed next to 
each other to form a large tiled image display. 

A difficulty with many of the video based multiple projector display systems 
is that the multiple images often do not appear as one single continuous image on the 

30 display screen. When multiple images are projected side-by-side and/or top-to- 
bottom on a single screen, there is normally a seam or overlapping region between 
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the images for example, an M x N projector array, where M and N are generally 
expressed as positive integer values, though, in using overlap and portions of 
displays, fractional values may be assigned. Also M x N projector arrays can be 
arranged to have constant and identical overlap or can be arranged to have varying 

5 degrees of overlap, depending on one's optimization criteria, which can include 
reliability, fault tolerance, cost and performance. The final display image will either 
appear as multiple images placed side-by-side with a gap between images or, if the 
images are made to overlap on a single screen, with a bright line or band there 
between. In the region of overlap the light from each projector will add to the output 

10 light of the other. This applies to the black output level as well. Ideally, when 

displaying a black image, this region of overlap should be generally uniformly black 
across the entire displayed image. Instead one generally observes the black image to 
brighten in the regions of overlap. When the images of two projectors overlap, the 
amount of light in the overlapped regions of the images is approximately double the 

1 5 amount of light observed on the screen in regions where only a single projector 

image resides; in regions where four projected images overlap, the amount of light is 
approximately four times that of the single projector image, and so on. Thus, the 
observer of the screen will generally see the output image containing objectionable 
artifacts. The same effects happen for white images, and for all images in between 

20 black and white. Generally, the black and the white images may be conceptualized as 
the upper and lower reference levels for constructing any image whose content spans 
these two extremes. 

The prior art, for example, in the Panoram tiled display resolved overlap 
issues by requiring the display device to have a black reference level having very 

25 low stray light. This needed CRTs, because CRTs have huge native contrast ratios 
and deep black, several times darker than other common display media such as LCD 
projectors and DMD projectors. While the deep-dark display or CRT-only * 
architecture might work well for many applications, it fails to meet requirements 
found in the cinematic, medical and other industries demanding high image quality 

30 and performance, hi these high performance applications, the contrast ratio 

requirements often exceed 1000:1. The cinema industry generally requires 1500:1, 
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and the medical industry generally requires displays for digital radiography having 
contrast ratios in the range of about 2000:1 to 4000:1. With the contrast ratio of 
CRTs at that or a lesser range, any overlapping strategy as used in the CRT-only 
architecture fails. It divides the contrast ratio by the number of CRTs used. Thus, for 
5 a cinematic application requiring a contrast ratio of 1 500: 1, any overlap of the CRTs 
will shrink the contrast ratio to 750: 1 in the region of overlap. Any regions having 
four CRTs overlapping in a 2 X 2 matrix, will show a quadrupling in brightness and 
thus a reduction in contrast ratio to a mere 375: 1 . This is observable and generally 
objectionable in the industry. 

10 Attempts have been made to hide such artifacts, one such example being 

raising the regions of non-overlap to the same brightness levels as the regions of 
overlap. Such practices are usually implemented by adjusting the input video level to 
obliterate the visibility of the regions of overlap. However, this method reduces the 
contrast ratio over the entire display, even in areas where only a single projector 

1 5 projects its image content And in cases where multiple CRTs or other imaging 
devices overlap their imagery, the contrast ratio over the entire display will be 
compromised accordingly. 

What is desired is a fall-off in intensity of black and white levels such that 
the superposed images produce a uniform luminance from center to edges, including 

20 the overlapped regions of the projected image. In practice, such an ideal luminance 
profile is difficult to achieve, as the displays generally exhibit a fall-off in intensity 
from the center of a displayed image to its edges. To attain a uniform, center to edge 
luminance profile requires clipping the display's native intensity at display center 
and elsewhere to the same value as at the edges. Unfortunately, this will result in the 

25 loss of the display's native brightness and will significantly reduce the power to 
image brightness conversion efficiency of the system. Another method based on 
insensitivity of human vision to low spatial frequency changes is to allow a fall-off 
of the luminance profile near the edges of the tiled image. In theory, such profiles 
can be achieved electronically by adjusting the video going into each display. The 

30 corrective functions can be multiplied by the image content and will result in a 

uniform output overmuch of the gray scales to be rendered. However, the closer the :; 



BNSOOplD: ^O__^_02197O4A2_L> 



WO 02/19704 



PCT/USO 1/27002 



input image approaches the black state, the more the actual deviates from the ideal 
using this method. This is because the input video commanding a black state on the 
display does not achieve a true black state in practice. This, as was explained above, 
is because display technologies generally pass or emit light even when displaying 
5 black. 

To overcome the limitations described above, a pending commonly assigned 
patent application to Chen et al, suggest using an optical function generator to 
generate a spatial gradient profile, then to apply the spatial gradient profile to a 
spatial filter and then to dispose the spatial filter anywhere in an image formation 

1 0 path of each of the displays to produce a seamless tiled display image. 

Generally, tiled displays require periodic re-calibration because the 
performance of their projectors and/or other hardware tend to change over time. To 
overcome this problem commonly assigned pending patent applications to Chen et 
al> suggest a method and apparatus to calibrate tiled displays not including spatial 

15 filters in their projectors. However, the method and apparatus disclosed in the 
pending patent application does not lend itself to calibrate the tiled displays 
including spatial filters in their projectors because the spatial filters generally change 
the luminance characteristics around the edges of the display. This can affect the 
displaying of a template used in the calibration process. Therefore, there is a need in 

20 the art for a method and apparatus to calibrate tiled displays including spatial filters 
in their projectors. 

Also, the pending patent applications disclose a method and apparatus that 
requires a lot of memory and hardware to calibrate the tiled displays. Therefore, 
there is also a need in the art for a method and apparatus that requires less memory, 
25 less hardware, and has an improved processing speed to produce a high-resolution 
tiled image. 

■ '- • - 

Summary of the Invention 

30 According to one aspect of the present invention, a method of calibrating a 

seamless tiled display image having multiple overlapping discrete images produced 

4 
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by multiple displays generates a display-to-screen spatial transformation function to 
reduce one or more undesirable geometric projector characteristics, for each of the 
projectors used in the tiled display. The method generates a screen-to-camera spatial 
transformation function to reduce one or more undesirable geometric camera 
5 characteristics for each of the cameras used in capturing the displayed images. The 
method requires generating a spatial luminance transformation function for effective 
color calibration for each of the display images in the tiled display. The method 
further requires inputting a high-resolution image into a tiled display processor to 
form the tiled images of the tiled display, and segmenting the inputted high- 

10 resolution image to form tiled images based on an array of images used in the tiled 
display. The method requires pre-warping the segmented tiled images using the 
display-to-screen spatial transformation function to reduce the one or more 
undesirable geometric projector characteristics. The method requires applying an 
inverse of the spatial-luminance transformation function to each of the pre-warped 

15 images to effectively blend colors in the tiled display images. 

Other aspects of the invention will be apparent on reading the following 
detailed description of the invention and viewing the drawings that form a part 
thereof. 



20 

Brief Description of the Drawings 

Figure 1 is a schematic diagram showing a tiled display system used to calibrate 
and generate a two by two array of images according to the present invention. 

Figure 2 illustrates a flow diagram of an electronic calibration process for a 
25 seamless tiled display system according to the present invention. 

Figure 3 illustrates a flow diagram of generating a screen-to-camera spatial 
transformation function according to the present invention. 

Figure 4 illustrates a flow diagram of generating a display-to-screen spatial 
transformation function according to the present invention. 
30 Figure 5 illustrates a flow diagram of generating a spatial-luminance 

transformation function according to the present invention. 

-V\.\. ; v :." ; . ■ 5 ' . \, *..■■ .. 
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Figure 6 illustrates a nine by nine dot pattern used in geometric distortion 
calibration. 

Figure 7 illustrates a resulting dot pattern when using a spatial filter in an image 
formation path of the display. 
5 Figure 8 illustrates one embodiment of a block diagram of a tiled display 

processor used in the system of Figure 1 . 

Figure 9 is a block diagram illustrating the calibration process according to the 
present invention. 

10 Detailed Description 

In the following detailed description, reference is made to the accompanying 
drawings, which form a part hereof, and in which is shown by way of illustration 
specific embodiments in which the invention may be practiced. These embodiments are 
described in sufficient detail to enable those skilled in the art to practice the invention, 
15 and it is to be understood that the embodiments may be combined, or that other 
embodiments may be utilized and that structural, logical and electrical changes may be 
made without departing from the spirit and scope of the present invention. The 
following detailed description is, therefore, not to be taken in a limiting sense, and the 
scope of the present invention is defined by the appended claims and their equivalents. 

20 

This document describes, among other things, a method and an apparatus for 
performing an electronic calibration on a tiled display system to reduce geometric 
distortion between screen-to-camera and projector-to-screen and color distortion to 
effectively blend colors in the display images of the tiled display. 

25 Figure 1 is a schematic diagram illustrating generally by way of example, but 

not by way of limitation, one embodiment of a tiled display system 100 according to the 
present invention. System 100 includes a two-by-two array of projectors 120 projecting 
images on to a display screen 1 10. Each of the two-by-two arrays of projectors 120 
includes a spatial filter 160 to produce a seamless tiled display image on to the screen 

30 110. The spatial filter 160 includes a spatial gradient profile to produce a seamless tiled 
display image. Spatial filter 1 60 can be disposed anywhere in an image formation path 

6 
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between each of the two-by-two array of projectors 120 and the screen 1 10. A camera 
130 is coupled to a tiled display processor 140. In one embodiment, camera 130 can be 
one or more cameras. 

Li the system 100 shown in Figure 1, the projectors 120 are arranged so that the 
5 images displayed on the screen have roughly similar size, overlap 150 and minimal 
spatial distortion. Generally, this manual coarse adjustment is quick and easy. In order 
to achieve a seamless tiled display image, each image has to be further calibrated before 
the images are sent to two-by-two array of projectors 120. This calibration is generally 
a fine adjustment to the projectors 120 and the camera 130. This is generally 

1 0 accomplished by doing an electronic calibration on the projectors 1 20, screen 110 and 
the camera 130. The purpose of the electronic calibration is to align the tiled images on 
the screen 110, blend tiled images seamlessly from one tiled image to another tiled 
image, and to reduce any luminance and chrominance variations inevitably left behind 
by the coarse manual adjustment. Although, it is possible to partially calibrate the tiled 

15 display system 100 by modifying optical components in each of the projectors 120, it 
is generally subject to time, temperature and other variations, making the coarse manual 
adjustment process impractical to implement. The tiled display system 100 shown in 
Figure 1, automatically calibrates, controls and provides a seamless tiled display using 
image processing techniques described below. 

20 Figure 2 is a flow diagram illustrating generally a method 200 6f doing an 

electronic calibration on a tiled display system to produce a seamless tiled display 
image. Method 200 includes determining a screen-to-camera spatial transformation 
function 210. Figure 3 illustrates one method 210 of determining a screen-to-camera 
spatial transformation function. Method 210 includes displaying a predetermined 

25 template on to the screen 310. Displaying the predetermined template can include 
disposing a physical predetermined template on to the screen. Alternatively, displaying 
the predetermined template can be achieved by generating the predetermined template 
by the tiled display processor and displaying on the screen. In this embodiment, the 
predetermined template is a dot pattern such as a 9 X 9 dot pattern 600 as shown in 

30 Figure 6* The next steps 320 and 330 include capturing the image of the displayed 
predetermined template using a camera and determining to see whether the captured 
, [. • : • \j7 ':V/V V : v •:• \ " ', J 
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image has one or more undesirable camera characteristics. The step of determining to 
see whether the captured image has one or more undesirable camera characteristics 
further includes comparing the captured image to a predetermined expected template 
to determine whether the captured image has the one or more undesirable 
5 characteristics. The next step 340 can include removing the predetermined template 
from the screen. The next step 350 includes generating a screen-to-camera spatial 
transformation function that can be applied to a captured image of the tiled display to 
reduce the one or more undesirable camera characteristics. 

Step 220 in the process 200 determines a display-to-screen spatial 
10 transformation function using the previously determined screen-to-camera spatial 
transformation function 210. Figure 4 illustrates one method 220 of determining the 
display-to-screen spatial transformation function. The method 220 includes disposing 
a spatial filter anywhere in an image path between the projector and the screen to 
modulate light to produce the seamless tiled display 410. The next step 420 includes 
1 5 displaying a subset of a first predetermined image on to a screen using a projector. The 
projector can be one or more projectors and the camera can be one or more cameras. In 
this example, the first predetermined image is a predetermined dot pattern such as a 9 
X 9 dot pattern 600 shown in Figure 6. The subset of the first predetermined image can 
be a 7 X 7 dot pattern 700 shown in Figure 7. This is due to the application of a spatial 
20 luminance profile on to the spatial filter to produce a seamless tiled display. The next 
step can include applying the screen-to-camera spatial transformation function to correct 
the captured image for screen-to-camera geometric. The next step 430 includes 
capturing the partially displayed first predetermined image using a camera. The next 
step 440 includes generating the rest of the first predetermined image not displayed on 
25 the screen due to the inclusion of the spatial filter between the projector and the screen- 
Generating the rest of the first predetermined image can include using an extrapolation 
function to generate edge dots of the 9 X 9 dot pattern not displayed due to the spatial 
filter in the image path between the projector and the screen. The extrapolating function 
can be a least squares fit of a polynomial function. The extrapolating function to 
30 generate the edge dots can be based on functions such as a quadratic or a higher order 
polynomial function, or a cubic-spline function. The captured subset of the first 

8 
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predetermined image is then combined with the generated portion of the rest of the 
predetermined image to form a composite of the first predetermined image 450. The 
next step 460 includes detennining whether the formed composite of the first 
predetermined image has one or more undesirable projector characteristics by 
5 comparing the formed first predetermined image with a predetermined expectation. The 
next step 470 includes generating a display-to-screen spatial transformation function 
that can be applied to an input video signal of the projector to reduce the undesirable 
projector characteristics. The input video signal is processed using the display-to-screen 
spatial transformation function to provide a first transformed input video signal to 

10 reduce the one or more undesirable projector characteristics. The steps of capturing, 
determining and processing can be repeated periodically. 

The next step 230 in the process 200 is to determine a spatial luminance 
transformation function for providing an effective color calibration. Figure 5 illustrates 
one method 230 of determining the spatial luminance transformation function. The 

15 method 230 includes the step 510 of sequentially displaying flat field images of varying 
intensities using the each of the projectors used in the tiled display system. Sequentially 
displaying flat field images includes displaying flat field images in red, green and blue 
primary colors with different gray scales. In another embodiment, sequentially 
displaying flat field images of varying intensities further defines gray scale levels of flat 

20 field images of varying intensities, and inputting signal that correspond to the defined 
gray scale levels of the flat field images of varying intensities. The next steps 520 and 
530 in determining the spatial luminance transformation function include capturing 
displayed flat field images of varying intensities using the camera used in the tiled 
display system, and normalizing the captured flat field images with respect to the 

25 highest and lowest flat field images. The captured flat field images of varying intensities 
can be corrected for screen-to-camera distortion by applying the screen-to-camera 
spatial transformation function. Normalizing the captured flat field images can further 
include geometrically warping back the flat field images to a rectangular coordinate 
system using the display-to-screen spatial transformation function, with a camera 

30 measured luminance as L(x,y) at a pixel position x and y. The gray level and the camera 
luminance are normalized with respect to their highest and lowest values. In one 
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embodiment, the highest and lowest gray scale values are 255 and 0, respectively. The 
camera luminance is normalized as 

5 where L^^x, y) and L min (x,y) are the luminance captured at = 255 and 0. The 
normalization process simplifies the algorithm and can accommodate a simpler 
hardware design for different color depths such as 24 or 30 bits. The normalization also 
separates fast varying components such as a light source, a light integrator or a 
condenser from slowly varying components such as non-uniform light valve 
10 transmission and the projector optical system. 

The next steps 540 and 550 include determining a gamma-corrected linearized 
luminance at a center of the displayed flat field images of varying intensities, and 
normalizing the flat field images with the gamma-corrected linearized luminance at the 
center of the displayed flat field images of varying intensities by computing the 
15 reference gray level as L nfjcaitRr = S^D^) = D' nf , where is the reference gray 
level in gamma corrected space and S^iPre/) = me inverse function that is 
applied to transform the image from the gamma-corrected space to the original space. 
The inverse gamma function is usually represented as discrete values, for example, eight 
or ten bit depth for each of the red, green, and blue colors. The input and 
20 corresponding output D ref values in discrete format are implemented in the hardware 
as a look-up-table for the gamma correction function to simplify the hardware 
implementation. Generally, it is difficult to do an inverse of a mathematical function 
such as the one described above using hardware. The use of a table simplifies the 
hardware design and implementation. The input and output discrete values can be stored 
25 in the memory. Although the I(x, v) is linearized at the center position with respect to 
D'^ , the same gamma transformation function at the center position of the tile S cmter do 
not linearize oiher positions, i.e. L^{x,y) = S XJf (p t¥ )=S XJ) (s; 1 (D^))=t XJ ,(D^ f ). In 



10 
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other words, S x y S c 1 = t x -* 1 , where S x y is the gamma transformation function for the 
pixel position (jc, y). 

The next step 560 generates a spatial function that can be applied to simulate 
each of the normalized flat field images and determines the spatial luminance 
5 transformation function for providing an effective color calibration. The deviation of 
the gamma transformation function at off-center positions, t , is usually a slowly- 
varying function and can be approximated by a linear combination of spatial 

functions L{x 9 y) = r x ^(ZJ')= £ fifp'yfay), where A(d') are the spatial 

M> 

coefficients for the corresponding functions f g (x 9 y). These spatial functions can be 

10 either global or local functions depending on the property of the projection system. 
In this embodiment, the spatial function is characterized as a local bilinear function 

L(x,y) = t X j{p'y £ A(^'>;(^j)=A(^'> + P\ (D')y + M&h + &(D'), 

where f 0 (x 9 y) = x 9 f x (x 9 y)=y 9 f 2 (x 9 y)=xy 9 f 3 (x 9 y) = 1, and m = 3. Further, the 
spatial coefficients /?,(©') can be represented as a linear combination of luminance 
15 functions. The next step 570 includes determining the spatial-luminance 

transformation function by characterizing luminance as a function of pixel position 
(xy) and image digital value D' .The spatial-luminance transformation function can 
be expressed analytically using a quadratic function as 

L(x 9 y) = (!>')== ][][ ^CyffayyXp ')f , where c v are the spatial-luminance 

20 coefficients. The digital image value of D' can then be derived as a standard 
quadratic function of luminance L at any pixel position (x 9 y). After the gamma 
correction with the aid of the table, the digital value D(x 9 y) is ready for use at the 
projectors. Other mathematical profiles other than quatratic, such as a higher order 
polynomial functions, can also be used to characterize the spatial-luminance 

25 transformation function. 
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Detennining the spatial-luminance transformation function can further 
include applying the spatial function to predetermined sections of each of the flat 
field images, and determining a first set of coefficients (spatial coeffcients $(z>')) 
of the spatial function for each of the predetermined sections of each of the flat field 
5 images and determining a second set of coefficinets (luminance coefficients c g ) for 

the first set of coefficients that will effectively blend colors in the tiled displays. 

Flat field images of varying intensities can include flat field images of 
monochrome, red, green and blue colors of varying gray scales. The varying intensities 
are chosen such that the luminance difference between two adjacent sampled intensities 

10 are small enough for the linear interpolation in between the varying intensities. Also 
in this embodiment, the highest and lowest flat field images means flat field images 
having a gray scale light intensity of 255 and 0, respectively. 

The next step 240 in the process 200 includes inputting a high-resolution raw 
image into the tiled display system. Step 250 includes an adjustment performed on the 

15 input raw image. The adjustment segments the high-resolution image to form the tiled 
images based on the array of images in the tiled display and can further include adding 
a predetermined overlapping region to each of the segmented images. The next step can 
include applying a ramping function to the overlapping region of each of the segmented 
images to ensure a correct proportion of color luminance mix in the overlapping region. 

20 In a representative system, the high-resolution raw image has a resolution of 2560 X 
2048 pixels and each of the four, segmented images have a resolution of 1280 X 1024 
pixels. 

The next step 260 in the process 200 includes pre-warping each of the 
segmented tiled images, including processing each of the segmented tiled images using 
25 the display-to-screen spatial transformation function to provide a first transformed input 
video signal to each of the projectors to reduce undesirable projector characteristics. 

The next step 270 in the process 200 includes applying an inverse of the spatial- 
luminance transformation function to each of the pre-warped images to effectively blend 
the colors in the tiled display images. This can be done by de-normalizing each of the 
30 applied pre-warped images, and applying a look-up-table to each of the de-normalized 

12 
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images to provide a second transformed input video signal to each of the projectors. 

Figure 8 shows a block diagram of the tiled display processor 140, including 
major components and their interconnections to the projectors 120 and to cameras 130. 
Processor 140 includes an analyzer 810, a comparator 820, and a memory 830. The 
analyzer 810 includes an image compositor 840, an image warper 850, and an image 
blender 860. Also shown in Figure 8, are the projectors 120 and the cameras 130 
coupled to the tiled display processor 140. 

Figure 9 illustrates one embodiment of segmenting the raw input video signal. 
In this embodiment, the raw input video signal has a high-resolution of 2560 x 2048 
pixels. In this embodiment the tiled display system 100 has a two-by-two array of tiles. 
In this embodiment, the analyzer 810 including the image compositor 840 segments the 
received high-resolution raw image into four images of a predetermined size before 
sending the segmented images to the respective projectors 120 for further processing. 
Each of the segmented images contains a certain overlap region 150 as shown in Figure 
1 (the overlap region 150 depends on a projector setup and a desired aspect-ratio 
arrangement). In the example embodiment shown in Figure 9, each of the four 
segmented images has a resolution of 1280 x 1024 pixels projected by each of the four 
projectors 910. After segmenting, the image compositor 840 applies a ramping function 
to the overlap region 150 to ensure a correct proportion of color luminance mixes for 
each of the segmented images. 

The image warper 850 receives the segmented images from the image 
compositor 840 and pre-warps each of the segmented images before sending the 
segmented images to the image blender 860 as shown in Figure 9. Pre-warping is done 
to align pixels among the adjacent projectors 120, and to correct for optical or 
mechanical distortions among the projectors 120, die cameras 130 and the screen 110. 
In one embodiment, the image warper 850 pre-warps the received segmented images, 
by using a display-to-screen spatial transformation function to provide a first 
transformed input video signal such that the one or more undesirable projector 
characteristics are reduced as described in steps 240, 250, 260 and 270. The display-to- 
screen spatial transformation function is computed using a screen-to-camera spatial 
transformation function as outlined below. 
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Each of the projectors 120 displays a predetermined template on to the screen 
1 10. hi one embodiment, the predetermined template is a physical template posted on 
to the screen 1 10. In another embodiment, the predetermined template is generated by 
the tiled display processor 140 and projected by each of the projectors 120. Then the 
5 camera 130 captures an image of the displayed predetermined template. In one 
embodiment, the predetermined template is a predetermined dot pattern. In the example 
embodiment shown in Figure 4, the predetermined dot pattern is a 9 X 9 dot pattern. 
Then the analyzer 810 determines whether the captured image has one or more 
undesirable camera characteristics. In one embodiment, the tiled display processor 
10 includes the comparator 820. In this embodiment, the comparator 820 compares the 
captured image with a predetermined expected template to determine whether the 
captured image has one or more undesirable camera characteristics such as key-stone, 
pin cushion, and barrel distortions. Then the analyzer 810 identifies a screen-to-camera 
spatial transformation function that can be applied to the input video signal of each of 
15 the projectors 120 to reduce the undesirable camera characteristics. 

Each of the projectors 120 including the spatial filter 160 displays a 
subset of a first predetermined image on to the screen 110. Each of the cameras 130 is 
used to capture the displayed subset of the first predetermined image on the screen 1 10. 
Then the analyzer 810 analyzes and corrects the captured image for screen-to-camera 
20 geometric distortion by applying the screen-to-camera spatial transformation function 
as described in step 210. Then the analyzer 810 generates a display-to-screen spatial 
transformation function that can be applied to an input video signal of each of the 
projectors 120 to reduce the undesirable projector characteristics as described in step 
220. Then the image warper 850 pre-warps the input video signal using the generated 
25 display-to-screen spatial transformation function to provide a first transformed input 
video signal to reduce the one or more undesirable projector characteristics. 

The segmented and pre-warped image is then filtered through the image blender 
860 using the spatial-luminance transformation function for proper color mixing 
via a search at each pixel position of each of the projectors 120. The spatial- 
30 luminance transformation function is computed using the color distortion 

calibration process as outlined in step 230. The image blending can be carried 
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out in the following stages:!. Apply the inverse function of the spatial- 
luminance transformation function as 



to the pre-warped first transformed input video signal. The slowly varying 
function of t~ l y allows sampling of the local bilinear functions at a much 

reduced resolution, such as 8x8, 16x16, or 32x32 blocks with the corresponding 
sets of local bilinear functions. Where 1^ is the input image of red, green, and 
blue colors. 

2. Denormalize the digital value D' with respect to the maximum D 9 m 
and minimum D'^ luminance. and D^ n are the fast varying function and 
need much finer sampled resolution than t~ l using 



Depending on the display characteristics, different sampling resolutions 
can be used. Blending usually requires full or close to full resolution to ensure 
a seamless image. With the disposition of the spatial filter 160 in each of the 
projectors 120, the requirement of close to full resolution is relaxed and a larger 
sampling period can be used. 

3 . Apply the look-up-table before feeding the image to the projectors 120 
to effectively blend the colors in the tiled images using 



Where /output is the output image of red, green, and blue colore. 
The use of a table can be useful for LCD projectors because of steep 
transmission-voltage characteristics. 




D'(x, y) = D 'O, y) x (D^ {x, y) - D'^ (x, y)) + DV, (*, y) . 



Io*pu,(x,y) = 255 x S^{D'{x t y)) 



In the overlap region 150, the luminance ramps down smoothly and 
monotonically from one image to another during color blending. In one embodiment, 
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approximately 80 pixels of overlap are used in the horizontal and vertical directions. 
Generally, color blending is easier to implement when more overlapping pixels are 
used. However, more overlapping pixels reduces effective resolution. 

The tiled display processor 140 further includes a memory 830. Memory 830 
5 is coupled to the analyzer 810 and comparator 820. In one embodiment, the memory 
830 stores the display-to-screen and screen-to-camera transformation coefficients, 
spatial-luminance transformation coefficients, and the gamma-corrected linearized 
luminance at the center of the displayed flat field images of varying intensities. 



10 Conclusion 

The above described tiled display system provides, among other things, a 
method and apparatus to calibrate tiled displays including spatial filters in their 
projectors. Also the tiled display system simplifies the hardware and improves 
processing speeds. 

15 The above description is intended to be illustrative, and not restrictive. Many 

other embodiments will be apparent to those of skill in the art. The scope of the 
invention should therefore be determined with reference to the appended claims, along 
with the full scope of equivalents to which such claims are entitled. 
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WHAT IS CLAIMED IS: 

1 . A method of calibrating a seamless tiled display, comprising: 
disposing a spatial filter in an image path; 
5 displaying a subset of a first predetermined image on a screen using a 

projector; 

capturing a subset of the displayed first predetermined image using a camera; 

generating the rest of the first predetermined image not displayed on the 
screen due to the inclusion of the spatial filter in the image path using the captured 
1 0 subset of the displayed first predetermined image; 

combining the captured subset of the first predetermined image with the 
generated rest of the first predetermined image to form a composite of the first 
predetermined image; 

determining whether the formed composite of the first predetermined image 
15 has one or more undesirable projector characteristics; and 

generating a display-to-screen spatial transformation function that can be 
applied to an input video signal of the projector to reduce the undesirable projector 
characteristics. 

20 2. The method of claim 1, further comprising: 

processing the input video signal using the display-to-screen spatial 
transformation function to provide a first transformed input video signal such that 
the one or more undesirable projector characteristics are reduced, 

25 3. The method of claim 2, further comprising: 

comparing the formed first pre-determined image with a predetermined 
expectation to determine whether the formed first pre-determined image has the one 
or more undesirable projector characteristics. 

30 4. The method of claim 2, further comprising: 
displaying an image on to the screen; and 
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manually adjusting the projector to have minimal spatial distortion in the 
displayed image. 

5 . The method of claim 4, wherein manually adjusting the projector comprises 
5 manually adjusting one or more projectors individually to obtain roughly a similar 

size, an overlap and a minimal spatial distortion of a displayed image. 

6. The method of claim 4, wherein the capturing, determining and processing 
actions are periodically repeated. 

10 

7. The method of claim 1, wherein the first predetermined image is a dot ? 
pattern. 

8. The method of claim 7, wherein generating the rest of the first predetermined 
15 image not displayed comprises using an extrapolation function to generate edge dots 

not displayed due to the disposing of the spatial filter in the image path. 

9. The method of claim 8, wherein the extrapolating function comprises a least 
squares fit of a polynomial function. 

20 

10. The method of claim 9, wherein the extrapolating function is selected from 
the group consisting of a quadratic or a higher order polynomial function and a 
cubic-spline function. 

25 11. The method of claim 1 , which further comprising: 

sequentially displaying flat field images of varying intensities using each of 
multiple projectors used in a tiled display system; 

i capturing displayed flat field images of varying intensities using the camera; 
normalizing the captured flat field images with respect to the highest and 
30 lowest flat field images for each of the multiple projectors; 

determining a gamma-corrected linearized luminance at a center of the 
displayed flat field images of varying intensities for each of the projectors; 
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normalizing the flat field images with the determined gamma-corrected 
linearized luminance at the center of the displayed flat field images of varying 
intensities for each of the multiple projectors; 

generating a spatial function that can be applied to simulate each of the 
5 normalized flat field images for each of the multiple projectors; and 

determining a spatial-luminance transformation function using the spatial 
function for providing an effective color calibration for each of the multiple 
projectors. 

10 12. The method of claim 1 1 , wherein sequentially displaying the flat field images 
of varying intensities using each of the projectors further comprising: 

defining gray scale levels of flat field images of varying intensities; and 
inputting signals that correspond to the defined gray scale levels of the flat 
field images of varying intensities. 

15 

1 3 . The method of claim 1 1 , wherein determining the spatial-luminance 
transformation function further comprising: 

applying the spatial function to predetermined sections of each of the flat 
field images; 

20 determining a first set of coefficients of the spatial function for each of the 

predetermined sections of each of the flat field images; 

generating the spatial-luminance transformation function that can simulate 

the determined first set of coefficients for each section of the predetermined sections 

of the normalized flat field images; and 
25 determining a second set of coefficients for the first set of coefficients that 

will effectively blend colors in the tiled displays. 

1 4. The method of claim 1 1 , wherein the spatial-luminance transformation 
function is' a quadratic or a higher order polynomial function. 

30 



19 

BNSDOCID: <WO 0219704A2J_> 



WO 02/19704 PCT/US01/27002 

15. The method of claim 1 1, wherein the flat field of varying intensities 
comprises flat field images of monochrome, red, green and blue colors of varying 
gray scales. 

5 16. The method of claim 1 1 , which further comprises: 

displaying a predetermined template on to the screen; 
_ capturing an image of the displayed predetermined template using the 
camera; 

detennining whether the captured image has one or more undesirable camera 
1 0 characteristics; 

removing the predetermined template from the screen; and 

generating a screen-to-camera spatial transformation function that can be 

applied to the images captured by the camera to correct for the one or more 

undesirable camera characteristics. 



15 
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17. The method of claim 16, further comprising: 

applying the screen-to-camera spatial transformation function to the captured 
subset of the displayed first predetermined image to reduce the one or more 
undesirable camera characteristics. 

18. The method of claim 16, further comprising: 

comparing the captured image with a predetermined expectation template to 
determine whether the captured image has the one or more undesirable camera 
characteristics. 

19. The method of claim 16, wherein displaying a predetermined template on the 
screen comprises disposing a physical predetermined template on to the screen. 

20. The method of claim 19, wherein the predetermined template is a dot pattern. 

21. The method of claim 16, further comprising: 
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segmenting a high-resolution image to form tiled images based on an array of 

images in the tiled display system; 

pre-waiping each of the segmented tiled images; and 

applying the spatial-luminance transformation function to each of the pre- 

warped tiled images to blend colors in the tiled display images. 

22 The method of claim 21, wherein segmenting a high-resolution image further 
comprising: 

inputting the high-resolution image; 

segmenting the high-resolution image to form the tiled images based on the 
array of images in the tiled display; 

adding a predetermined overlapping region to each of the segmented images; 

and 

applying a ramping function to the overlapping region of each of the 
segmented images to ensure a correct proportion of color luminance mix in the 
overlapping region. 

23. The method of claim 21, wherein pre-warping each of the segmented tiled 
images further comprising: 

processing each of the segmented tiled images using the display-to-screen 
spatial transformation function to provide a first transformed input video signal to 
each of the projectors to reduce one or more undesirable projector characteristics. 

24. The method of claim 21, wherein applying an inverse of the spatial- 
luminance transformation function to each of the pre-warped images to blend colors 
in the tiled display images further comprising: 

applying an inverse of the spatial-luminance transformation function to each 

of the pre-warped images; 

de-normalizing each of the applied pre-warped images; and 

applying a look-up table to each of the de-normalized images to provide a 

second transformed input video signal to each of the one or more projectors, 

respectively. 
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25 . A method of reducing one or more undesirable characteristics in a tiled 
display system, comprising: 

generating an image of a predetermined dot pattern using a line generator; 
5 displaying the generated image of the predetermined dot pattern on to a 

screen using a projector including a spatial filter to modulate light to produce a 
seamless tiled display; 

capturing the displayed image of the predetermined dot pattern using a 
camera; 

1 0 comparing the captured predetermined dot pattern with a predetermined 

expected dot pattern to determine whether the formed predetermined dot pattern has 
the one or more undesirable projector characteristics; 

generating a display-to-screen spatial transformation function that can be 
applied to an input video signal of the projector to reduce the undesirable projector 
15 characteristics; and 

processing the input video signal using the display-to-screen spatial 
transformation function to provide a first transformed input video signal such that 
the one or more undesirable projector characteristics are reduced. 

20 26. The method of claim 25, wherein comparing the formed predetermined dot 
pattern with a predetermined expectation dot pattern further comprising: 

calculating dot locations by subtracting a black captured image from the 
captured image; and 

sorting the calculated dot locations with known dot locations of Hie 
25 predetermined expected dot pattern. 

27. The method of claim 26, wherein generating the display-to-screen spatial 
transformation function comprises generating the display-to-screen spatial 
transformation function based on an outcome of sorting the calculated dot locations 

30 with the known dot locations. 

28. A seamless tiled display system, comprising: 
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a spatial filter including a spatial gradient profile disposed in an image path 
between each of multiple projectors and a screen, respectively to produce a seamless 
tiled display; 

a camera for capturing a subset of a first predetermined image displayed by 
5 each of the multiple projectors; and 

a tiled display processor, coupled to each of the multiple projectors and the 
camera, wherein the tiled display processor further comprises: 

an analyzer to generate the rest of the first predetermined image that 
is not displayed due to the disposition of the spatial filter in the image path 
10 between the projector and the screen, wherein the analyzer combines the 

generated first predetermined image with the captured subset of the first 
predetermined image to form a composite of the first predetermined image, x 
wherein the analyzer determines whether the formed composite first 
predetennined image has one or more undesirable projector characteristics, 
15 and the analyzer further 

■A 

identifies a display-to-screen spatial transformation function that can 
be applied to an input video signal of the projector to reduce the undesirable 
projector characteristics; and 

processes the input video signal using the identified display-to-screen 
20 spatial transformation function to provide a first transformed input video 

signal such that the one or more undesirable projector characteristics are 
reduced. 

29. The system of claim 28, wherein the processor further comprises a 
25 comparator coupled to the analyzer to receive the formed composite of the first 
predetermined image from the analyzer and to compare the received formed 
composite of the first predetermined image with a predetermined expectation to . 
determine whether the formed composite of the first predetermined image has the 
one or more undesirable projector characteristics. 



30 



30. The system of claim 28, wherein the first predetermined image is a dot 
pattern. 
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3 1 . The system of claim 28, wherein the analyzer generates the rest of the first 
predetermined image using an extrapolation function. 

5 32. The system of claim 3 1 , wherein the extrapolation function comprises a least 
squares fit of a polynomial function. 

33 . The system of claim 32, wherein the extrapolation function is selected from 
the group consisting of a quadratic or a higher order polynomial function and a 

10 cubic-spline function, 

34. The system of claim 28, wherein the analyzer further 

displays flat field images of varying intensities using the projector, and the 
camera captures the displayed flat field images of varying intensities; 

1 5 normalizes the captured flat field images with respect to highest and lowest 

gray scale flat field images and determines a gamma-corrected linearized luminance 
at a center of the displayed flat field images of varying intensities, and further 
normalizes the flat field images with the determined gamma-corrected linearized 
luminance at the center of the displayed flat field images of varying intensities; and 

20 identifies a spatial function that can be applied to simulate each of the 

normalized flat field images and determines a spatial-luminance transformation 
function using the spatial function for providing an effective color calibration. 

35. The system of claim 34, wherein the analyzer 
25 determines the spatiaMuminance transformation function by applying spatial 

function to predetermined sections of each of the flat field images; 

determines a first set of coefficients of the spatial function for each of the flat 
field images, and further identifies the spatial-luminance transformation function 
that can simulate the determined first set of coefficients for each section of the 
30 predetermined section of the normalized flat field images; and 

determines a second set of coefficients for the first set of coefficients that 
will effectively blend colors in the tiled displays. 
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36. The system of claim 35, wherein the spatial function is a local bilinear 
function. 

5 37. The system of claim 36, wherein the spatial-luminance transfonnation 
function is a quadratic or a higher order polynomial function. 

38. The system of claim 36, wherein the flat field images of varying intensities 
comprises flat field images of monochrome, red, green and blue colors of varying 

10 grayscales. 

39. The system of claim 36, wherein the tiled display processor further comprises 
a memory, coupled to the analyzer and the comparator, to store gamma-corrected 
linearized luminance at the center of the displayed flat field images of varying 

15 intensities and a look-up-table for the spatial-luminance transformation function. 

40. The system of claim 36, wherein the projector further displays a 
predetermined template on to the screen, the camera further captures an image of the 
displayed predetermined template, and the analyzer further determines whether the 

20 captured image has one or more undesirable camera characteristics, and generates a 
screen-to-camera spatial transformation function to reduce the one or more 
undesirable camera characteristics. 

41. The system of claim 40, wherein the analyzer applies the screen-to-camera 
25 spatial transformation function to the captured subset of the first predetermined 

image to reduce the one or more undesirable camera characteristics. 

42. The system of claim 40, wherein the predetermined template is a dot pattern. 
30 43. The system of claim 40, wherein the analyzer 
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segments a high-resolution image into tiled images based on an array of 
displayed images and regions of overlap between the arrays of displayed images of 
the tiled system; 

pre-warps each of the segmented tiled images; and 
5 applies the spatial-luminance transformation function to each of the pre- 

warped tiled images to effectively blend colors in the tiled displays. 

44. The system of claim 43, wherein the analyzer further 

segments the high-resolution image into the tiled displays by adding a 
10 predetermined overlapping region to each of the segmented tiled images; and 
applies a ramping function to the overlapping region of each of the 

segmented tiled images to ensure a correct proportion of color luminance mix in the 

overlapping region. 

15 45. The seamless tiled display system of claim 43, wherein the analyzer further 
pre-warps each of the segmented tiled images by processing each of the segmented 
tiled images using the display-to-screen spatial transformation function to provide a 
first transformed input video signal such that the one or more undesirable projector 
characteristics are reduced. 

20 

46. The seamless tiled display system of claim 45, wherein the analyzer further 

applies an inverse of the spatial-luminance transformation function to each of 
the pre-warped images; 

de-normalizes each of the applied pre-warped images; and 
25 applies a look-up table to each of the de-normalized images before inputting 

each of the images into the one or more projectors to blend colors in the tiled display 
images. 

30 47. A method of calibrating a seamless tiled display (100), comprising: 
disposing a spatial filter (160) in an image path; 
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displaying a subset of a first predetermined image on a screen (1 10) using a 
projector (120); 

capturing a subset of the displayed first predetermined image using a camera 

(130); 

5 generating the rest of the first known image not displayed on the screen due 

to the inclusion of the spatial filter (160) in the image path using the captured subset 
of the displayed first predetermined image; 

combining the captured subset of the first predetermined image with the 
generated rest of the first predetermined image to form a composite of the first 
10 predetermined image; 

determining%hether the formed composite of the first predetermined image 
has one or more undesirable projector characteristics; and 

generating a display-to-screen spatial transformation function that can be 
applied to an input video signal of the projector to reduce the undesirable projector 
15 characteristics. 

48. The method of claim 1, further comprising: 

processing the input video signal using the display-to-screen spatial 
transformation function to provide a first transformed input video signal such that 
20 the one or more undesirable projector characteristics are reduced. 

49. The method of claim 48, further comprising: 

comparing the formed first pre-determined image with a predetermined 
expectation to determine whether the formed first pre-determined image has the one 
25 or more undesirable projector characteristics. 

50. The method of claim 48, further comprising: 
displaying an image on to the screen (110); and 

30 manually adjusting the projector (120) to have minimal spatial distortion in 

the displayed image. \ 
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51. The method of claim 50, wherein manually adjusting the projector comprises 
manually adjusting one or more projectors (120) individually to obtain roughly a 
similar size, an overlap and a minimal spatial distortion of a displayed image. 

5 52. The method of claim 50, wherein the capturing, determining and processing 
actions are periodically repeated. 

53 . The method of claim 47, wherein the first predetermined image is a dot 
pattern. 

10 

54. The method of claim 47, wherein generating the rest of the first 
predetermined image not displayed comprises using an extrapolation function to 
generate edge dots not displayed due to the disposing of the spatial filter (160) in the 
image path. 

15 

55. The method of claim 54, wherein the extrapolating function comprises a least 
squares fit of a polynomial function. 

56. The method of claim 55, wherein the extrapolating function is selected from 
20 the group consisting of a quadratic or a higher order polynomial function and a 

cubic-spline function. 



25 57. The method of claim 46, which further comprising: 

sequentially displaying flat field images of varying intensities using each of 
multiple projectors used in a tiled display system (100); 

capturing displayed flat field images of varying intensities using the camera 

(130); 

30 normalizing the captured flat field images with respect to the highest and 

lowest flat field images for each of the multiple projectors (120); 
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determining a gamma-corrected linearized luminance at a center of the 
displayed flat field images of varying intensities for each of the projectors (120); 

normalizing the flat field images with the determined gamma-corrected 
linearized luminance at the center of the displayed flat field images of varying 
5 intensities for each of the multiple projectors (120); 

generating a spatial function that can be applied to simulate each of the 
normalized flat field images for each of the multiple projectors (120); and 

determining a spatial-luminance transformation function using the spatial 
function for providing an effective color calibration for each of the multiple 
10 projectors (120). 

58. The method of claim 57, wherein sequentially displaying the flat field images 
of varying intensities using each of the proj ectors further comprising: 

defining gray scale levels of flat field images of varying intensities; and 
15 inputting signals that correspond to the defined gray scale levels of the flat 

field images of varying intensities. 

59. The method of claim 57, wherein determining the spatial-luminance 
transformation function further comprising: 

20 applying the spatial function to predetermined sections of each of the flat 

field images; 

determining a first set of coefficients of the spatial function for each of the 
predetermined sections of each of the flat field images; 

generating the spatial-luminance transformation function that can simulate 
25 the determined first set of coefficients for each section of the predetermined sections 
of the normalized flat field images; and 

determining a second set of coefficients for the first set of coefficients that 
will effectively blend colors in the tiled displays. 

30 60. The method of claim 57, wherein the spatial-luminance transformation 
function is a quadratic or a higher order polynomial function. 
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61. The method of claim 57, wherein the flat field of varying intensities 
comprises flat field images of monochrome, red, green and blue colors of varying 
grayscales. 

5 62. The method of claim 57, which further comprises: 

displaying a predetermined template on to the screen (1 10); 

capturing an image of the displayed predetermined template using the camera 

(130); 

determining whether the captured image has one or more undesirable camera 
10 characteristics; 

removing the predetermined template from the screen (110); and 
generating a screen-to-camera spatial transformation function that can be 

applied to the images captured by the camera to correct for the one or more 

undesirable camera characteristics. 

15 

63. The method of claim 62, further comprising: 
applying the screen-to-camera spatial transformation function to the captured 

subset of the displayed first predetermined image to reduce the one or more 
undesirable camera characteristics. 

64. The method of claim 62, further comprising: 
comparing the captured image with a predetermined expectation template to 

determine whether the captured image has the one or more undesirable camera 
characteristics. 

65. The method of claim 62, wherein displaying a predetermined template on the 
screen comprises disposing a physical predetermined template on to the screen 
(110). 

66. The method of claim 65, wherein the predetermined template is a dot pattern. 

67. The method of claim 62, further comprising: 

30 
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segmenting a high-resolution image to form tiled images based on an array of 
images in the tiled display system ( 1 00); 

pre-warping each of the segmented tiled images; and 
applying the spatial-luminance transformation function to each of the pre- 
5 warped tiled images to blend colors in the tiled display images. 

68 The method of claim 67, wherein segmenting a high-resolution image further 
comprising: 

inputting the high-resolution image; 
10 segmenting the high-resolution image to form the tiled images based on the 

array of images in the tiled display; 

adding a predetermined overlapping region to each of the segmented images; 

and 

applying a ramping function to the overlapping region of each of the 
15 segmented images to ensure a correct proportion of color luminance mix in the 
overlapping region, 

69. The method of claim 67, wherein pre-warping each of the segmented tiled 
images further comprising: 
20 processing each of the segmented tiled images using the display-to-screen 

spatial transformation function to provide a first transformed input video signal to 
each of the projectors to reduce one or more undesirable projector characteristics. 



70. The method of claim 67, wherein applying an inverse of the spatial- 
25 luminance transformation function to each of the pre-warped images to blend colors 
in the tiled display images further comprising: 

applying an inverse of the spatial-luminance transformation function to each 
of the pre-warped images; 

de-normalizing each of the applied pre- warped images; and 
30 applying a look-up table to each of the de-normalized images to provide a 

second transformed input video signal to each of the one or more projectors (120), 
respectively. 
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71. A method of reducing one or more undesirable characteristics in a tiled 
display system (100), comprising: 

generating an image of a predetermined dot pattern using a line generator; 
5 displaying the generated image of the predetermined dot pattern on to a 

screen (1 10) using a projector (120) including a spatial filter (160) to modulate light 
to produce a seamless tiled display; 

capturing the displayed image of the predetermined dot pattern using a 
camera; 

1 0 comparing the captured predetermined dot pattern with a predetermined 

expected dot pattern to determine whether the formed predetermined dot pattern has 
the one or more undesirable projector characteristics; 

generating a display-to-screen spatial transformation function that can be 
applied to an input video signal of the projector to reduce the undesirable projector 
15 characteristics; and 

processing the input video signal using the display-to-screen spatial 
transformation function to provide a first transformed input video signal such that 
the one or more undesirable projector characteristics are reduced. 



20 72. The method of claim 7 1 , wherein comparing the formed predetermined dot 
pattern with a predetermined expectation dot pattern further comprising: 

calculating dot locations by subtracting a black captured image from the 
captured image; and 

sorting the calculated dot locations with known dot locations of the 
25 predetermined expected dot pattern. 

73. The method of claim 7 1 , wherein generating the display-to-screen spatial 
transformation function comprises generating the display-to-screen spatial 
transformation function based on an outcome of sorting the calculated dot locations 

30 with the known dot locations. 

74. A seamless tiled display system (100), comprising: 
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a spatial filter (160) including a spatial gradient profile disposed in an image 
path between each of multiple projectors (120) and a screen (110), respectively to 
produce a seamless tiled display (100); 

a camera (130) for capturing a subset of a first predetermined image 
5 displayed by each of the multiple projectors (120); and 

a tiled display processor (140), coupled to each of the multiple projectors 
(120) and the camera (130), wherein the tiled display processor (1 40) further 
comprises: 

an analyzer (810) to generate the rest of the first predetermined image 
10. that is not displayed due to the disposition of the spatial filter (160) in the 

image path between the projector and the screen, wherein the analyzer 
combines the generated first predetermined image with the captured subset of 
the first predetermined image to form a composite of the first predetermined 
image, wherein the analyzer (810) determines whether the formed composite 
1 5 first predetermined image has one or more undesirable projector 

characteristics, and the analyzer (810) further 

identifies a display-to-screen spatial transformation function that can 
be applied to an input video signal of the projector to reduce the undesirable 
projector characteristics; and 
20 processes the input video signal using the identified display-to-screen 

spatial transformation function to provide a first transformed input video 
signal such that the one or more undesirable projector characteristics are 
reduced. 

25 75. The system of claim 74, wherein the processor (140) further comprises a 

comparator (820) coupled to the analyzer (810) to receive the formed composite of 
the first predetermined image from the analyzer (810) and to compare the received 
formed composite of the first predetermined image with a predetermined expectation 
to detenriine whether the formed composite of the first predetermined image has the 

30 one or more undesirable projector charactaistics. 
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76. The system of claim 74, wherein the first predetermined image is a dot 
pattern. 

77. The system of claim 74, wherein the analyzer (810) generates the rest of the 
5 first predetermined image using an extrapolation function. 

78. The system of claim 77, wherein the extrapolation function comprises a least 
squares fit of a polynomial function. 

10 79. The system of claim 78, wherein the extrapolation function is selected from 
the group consisting of a quadratic or a higher order polynomial function and a 
cubic-spline function. 

80. The system of claim 74, wherein the analyzer (810) further 
15 displays flat field images of varying intensities using the projector (120), and 

the camera (130) captures the displayed flat field images of varying intensities; 

normalizes the captured flat field images with respect to highest and lowest 

gray scale flat field images and determines a gamma-corrected linearized luminance 

at a center of the displayed flat field images of varying intensities, and further 
20 normalizes the flat field images with the determined gamma-corrected linearized 

luminance at the center of the displayed flat field images of varying intensities; and 
identifies a spatial function that can be applied to simulate each of the 

normalized flat field images and determines a spatial-luminance transformation 

function using the spatial function for providing an effective color calibration. 

25 

81. The system of claim 80, wherein the analyzer (810) 

determines the spatial-luminance transformation function by applying spatial 
function to predetermined sections of each of the flat field images; 

determines a first set of coefficients of the spatial function for each of the flat 
30 field images, and further identifies the spatial-luminance transformation function 
that can simulate the determined first set of coefficients for each section of the 
predetermined section of the normalized flat field images; and 
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determines a second set of coefficients for the first set of coefficients that 
will effectively blend colors in the tiled displays. 

82. The system of claim 8 1 , wherein the spatial function is a local bilinear 
5 function. 

83. The system of claim 82, wherein the spatial-luminance transformation 
function is a quadratic or a higher order polynomial function. 

10 84. The system of claim 82, wherein the flat field images of varying intensities 
comprises flat field images of monochrome, red, green and blue colors of varying 
grayscales. 

85. The system of claim 82, wherein the tiled display processor (140) further 
1 5 comprises a memory (830), coupled to the analyzer (8 1 0) and the comparator (820), 
to store gamma-corrected linearized luminance at the center of the displayed flat 
field images of varying intensities and a look-up-table for the spatial-luminance 
transformation function. 

20 86. The system of claim 82, wherein the projector (120) further displays a 

predetermined template on to the screen (110), the camera (130) further captures an 
image of the displayed predetermined template, and the analyzer (8 1 0) further 
determines whether the captured image has one or more undesirable camera 
characteristics, and generates a screen-to-camera spatial transformation function to 

25 reduce the one or more undesirable camera characteristics. 

qy 87. The system of claim 86, wherein the analyzer (810) applies the screen-to- 

camera spatial transformation function to the captured subset of the first 
predetermined image to reduce the one or more undesirable camera characteristics. 
30 *' 

88. The system of claim 86, wherein the predetermined template is a dot pattern. 
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89- The system of claim 40, wherein the analyzer (8 10) 

segments a high-resolution image into tiled images based on an array of 
displayed images and regions of overlap between the arrays of displayed images of 
the tiled system (100); 
5 pre-warps each of the segmented tiled images; and 

applies the spatial-luminance transformation function to each of the pre- 
warped tiled images to effectively blend colors in the tiled displays. 

90. The system of claim 89, wherein the analyzer (810) further 

1 0 segments the high-resolution image into the tiled displays by adding a 

predetermined overlapping region to each of the segmented tiled images; and 

applies a ramping function to the overlapping region of each of the 
segmented tiled images to ensure a correct proportion of color luminance mix in the 
overlapping region, 

15 

91 . The seamless tiled display system of claim 89, wherein the analyzer (810) 
further pre-warps each of the segmented tiled images by processing each of the 
segmented tiled images using the display-to-screen spatial transformation function to 
provide a first transformed input video signal such that the one or more undesirable 

20 projector characteristics are reduced. 



92. The seamless tiled display system of claim 91, wherein the analyzer (810) 
further 

applies an inverse of the spatial-luminance transformation function to each of 
25 the pre-warped images; 

de-normalizes each of the applied pre-warped images; and 

applies a look-up table to each of the de-normalized images before inputting 

each of the images into the one or more projectors (120) to blend colors in the tiled 

display images. 
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